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Abstract 

The isolation lemma of Mulmuley et al IIMVV87I is an important tool in the design of randomized 
algorithms and has played an important role in several nontrivial complexity upper bounds. On the other 
hand, polynomial identity testing is a well-studied algorithmic problem with efficient randomized algo- 
rithms and the problem of obtaining efficient deterministic identity tests has received a lot of attention 
recently. The goal of this note is to compare the isolation lemma with polynomial identity testing: 

1 . We show that derandomizing reasonably restricted versions of the isolation lemma implies circuit 
size lower bounds. We derive the circuit lower bounds by examining the connection between the 
isolation lemma and polynomial identity testing. We give a randomized polynomial-time identity 
test for noncommutative circuits of polynomial degree based on the isolation lemma. Using this 
result, we show that derandomizing the isolation lemma implies noncommutative circuit size lower 
bounds. The restricted versions of the isolation lemma we consider are natural and would suffice 
for the standard applications of the isolation lemma. 

2. From the result of Klivans-Spielman IIKSOlll we observe that there is a randomized polynomial- 
time identity test for commutative circuits of polynomial degree, also based on a more general 
isolation lemma for linear forms. Consequently, derandomization of (a suitable version of) this 
isolation lemma implies that either NEXP ^ P/poly or the Permanent over Z does not have 
polynomial-size arithmetic circuits. 

1 Introduction 

We recall the Isolation Lemma ||MVV87i . Let [n] denote the set {1, 2, • • • , n}. Let [7 be a set of size n 
and JF C 2*^ be any family of subsets of U. Let w : U ^ Z+ be a weight function that assigns positive 
integer weights to the elements of U. For T C U, define its weight w{T) as w{T) = J2ueT''^i'^)- Then 
Isolation Lemma guarantees that for any family of subsets ^ of C7 and for any random weight assigimient 
w : U ^ [2n], with high probability there will be a unique minimum weight set in J^. 

Lemma 1.1 (Isolation Lemma) IIMVV8 71 Let U be an universe of size n and T be any family of subsets 
of U. Let w : U —>■ [2n] denote a weight assignment function to elements of U. Then, 

Probio [ There exists a unique minimum weight set in JF] > - , 
where the weight function w is picked uniformly at random. 
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In the seminal paper IIMVV87I Mulmuley et al apply the isolation lemma to give a randomized NC 
algorithm for computing maximum cardinality matchings for general graphs (also see IIARZ99II ). Since 
then the isolation lemma has found several other applications. For example, it is crucially used in the 
proof of the result that NL C UL/poly [ AROO] and in designing randomized NC algorithms for linear 
representable matroid problems IINSV941 . It is also known that the isolation lemma can be used to prove the 
Valiant- Vazirani lemma that SAT is many-one reducible via randomized reductions to USAT. 

Whether the matching problem is in deterministic NC, and whether NL C UL are outstanding open 
problems. Thus, the question whether the isolation lemma can be derandomized is clearly important. 



As noted in |Agr07|, it is easy to see by a counting argument that the isolation lemma can not be 
derandomized, in general, because there are 2^" set systems T. More formally, the following is observed in 



Observation 1.2 | Agr07 1 The Isolation Lemma can not he fully derandomized if we allow weight functions 
w : U ^ [n'^] for a constant c (i.e. weight functions with a polynomial range). More precisely, for any 
polynomially bounded collection of weight assignments {wi}i^\nc^ with weight range [n% there exists a 
family T of [n] such that for all j £ [n'^'^], there exists two minimal weight subsets with respect to wj. 

However that does not rule out the derandomization of any special usage of the isolation lemma. In- 
deed, for all applications of the isolation lemma (mentioned above, for instance) we are interested only in 
exponentially many set systems JF C 2^ . 

We make the setting more precise by giving a general framework. Fix the universe U = [n] and consider 
an n-input boolean circuit C where size (C) = m. The set 2^ of all subsets of U is in a natural 1-1 
correspondence with the length n-binary strings {0, 1}": each subset S U corresponds to its characteristic 
binary string xs G {0, 1}" whose i*^ bit is 1 iff i E S. Thus the n-input boolean circuit C implicitly defines 
the set system 

:Fc = {S^ [n] I Cixs) = 1}. 
As an easy consequence of Lemma ll.ll we have the following. 

Lemma 1.3 Let U be an universe of size n and C be an n-input boolean circuit of size m. Let Tc ^ be 
the family of subsets ofU defined by circuit C. Let w : U ^ [2n] denote a weight assignment function to 
elements of U. Then, 

Prob^[ There exists a unique minimum weight set in Tc] > — j 

where the weight function w is picked uniformly at random. Furthermore, there is a collection of weight 
functions {wi}i<i<p[m,n)' where p{m,n) is a fixed polynomial, such that for each Tc there is a weight 
function Wi w.r.t. which there is a unique minimum weight set in Tc- 

Lemma 11.31 allows us to formulate two natural and reasonable derandomization hypotheses for the 
isolation lemma. 



Hypothesis 1. There is a deterministic algorithm A\ that takes as input {C,n), where C is an n-input 
boolean circuit, and outputs a collection of weight functions wi,W2,- " such that Wi : [n] — > [2n\ , with 
the property that for some Wi there is a unique minimum weight set in the set system Tc- Furthermore, Ai 
runs in time subexponential in size{C). 
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Hypothesis 2. There is a deterministic algorithm A2 that takes as input (m, n) in unary and outputs a 
collection of weight functions w\^W2^ - • • ,wt such that Wi : [n] [2n] , with the property that for each size 
m boolean circuit C with n inputs there is some weight function Wi w.r.t. which J^c has a unique minimum 
weight set. Furthermore, A2 runs in time polynomial in m. 

Clearly, Hypothesis 2 is stronger than Hypothesis 1. It demands a "black-box" derandomization in the 
sense that A2 efficiently computes a collection of weight functions that will work for any set system in 2^ 
specified by a boolean circuit of size m. 

Notice that a random collection wi, - ■ ■ ,wt of weight functions will fulfil the required property of either 
hypotheses with high probability. Thus, the derandomization hypotheses are plausible. Indeed, it is not hard 
to see that suitable standard hardness assumptions that yield pseudorandom generators for derandomizing 
BPP would imply these hypotheses. We do not elaborate on this here. In this paper we show the following 
consequences of Hypotheses 1 and 2. 

1. Hypothesis 1 implies that either NEXP ^ P/poly or the Permanent does not have polynomial size 
noncommutative arithmetic circuits. 

2. Hypothesis 2 implies that for each n there is an explicit polynomial fnixi,X2,--- ,Xn) G 
F{xi, X2, - ■ ■ ,Xn} in noncommuting variables Xj (where by explicit we mean that the coefficients 
of the polynomial fn are computable by a uniform algorithm in time exponential in n) that does not 
have noncommutative arithmetic circuits of size 2°("^s") (where the field F is either the rationals or a 
finite field). 

These two results are a consequence of an identity testing algorithm for noncommutative circuits that 
is based on the isolation lemma. This algorithm is based on ideas from IIAMS08 1 where we used automata 
theory to pick matrices from a suitable matrix ring and evaluate the given arithmetic circuit on these matrices. 
In the next section, we describe the background and then give the identity test in the following section. 

Remark 1.4 Notice that derandomizing the isolation lemma in specific applications like the RNC algo- 
rithm for matchings IIMVV87II and the containment NL C UL/poly [,AROO I might still be possible without 
implying such circuit size lower bounds. 

Noncommutative polynomial identity testing has been the focus of recent research IRS 051 IBW051 
IAMS08II . One reason to believe that it could be easier than the commutative case to derandomize is because 
lower bounds are somewhat easier to prove in the noncommutative setting as shown by Nisan IIN9II . Using 
a rank argument Nisan has shown exponential size lower bounds for noncommutative formulas (and non- 
commutative algebraic branching programs) that compute the noncommutative permanent or determinant 
polynomials in the ring F{xi, • • • ,Xn) where Xi are noncommuting variables. However, no superpolyno- 
mial lower bounds are known for the size of noncommutative circuits for explicit polynomials. 

Our result in this paper is similar in flavor to the Impagliazzo-Kabanets result IIKI03II . where for commu- 
tative polynomial identity testing they show that derandomizing polynomial identity testing implies circuit 
lower bounds. Specifically, it implies that either NEXP (/L P/poly or the integer Permanent does not have 
polynomial-size arithmetic circuits. 

In IIAMS08 I we have observed that an analogous result also holds in the noncommutative setting. I.e., 
if noncommutative PIT has a deterministic polynomial-time algorithm then either NEXP P/poly or the 
noncommutative Permanent function does not have polynomial-size noncommutative circuits. 
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The connection that we show here between deiandomizing the isolation lemma and noncommutative 
circuit size lower bounds is based on the above observation and our noncommutative polynomial identity 
test based on the isolation lemma. 



Commutative circuits 

Klivans and Spielman IIKSOlll apply a more general form of the isolation lemma to obtain a polynomial 
identity test (in the commutative) case. This lemma is stated below. 

Lemma 1.5 HKSOll Lemma 4] Let L be any collection of linear forms over variables zi,Z2, - - - ,Zn with 
integer coefficients in the range {0, 1, • • • , K}. If each Zi is picked independently and uniformly at random 
from {0, 1, • • • , 2Kn} then with probability at least 1/2 there is a unique linear form from C that attains 
minimum value at {zi, - ■ ■ , Zn)- 

We can formulate a restricted version of this lemma similar to Lemma [T3] that will apply only to sets of 
linear forms L accepted by a boolean circuit C. More precisely, an integer vector (ai, • • • , a„) such that 
aj € {0, • • • , K} is in L if and only if (ai, • • • , a„) is accepted by the boolean circuit C. 

Thus, for this form of the isolation lemma we can formulate another derandomization hypothesis 
analogous to Hypothesis 1 as follows. 

Hypothesis 3. There is a deterministic algorithm ^As that takes as input (C, n, K), where C is a boolean 
circuit that takes as input (ai, • • • , a„) such that ai G {0, • • • , K}, and outputs a collection of weight 
functions wi,W2, - ■ ■ ,wt such that Wi : [n] [2Kn\, with the property that for some weight vector Wi 
there is a unique linear form (ai, • • • , a„) accepted by C which attains the minimum value Yl]=i Wi{j)aj. 
Furthermore, ^3 runs in time subexponential in size{C). 

2 Automata Theory background 

We recall some standard automata theory IIHU78i . Fix a finite automaton A = {Q,S,qo,qf) which takes 
inputs in {0, 1}*, Q is the set of states, 6 : Q x {0,1} Q is the transition function, and q^ and qj are 
the initial and final states respectively (we only consider automata with unique accepting states). For each 
b G {0, 1}, let 6i) : Q Q be defined by: = 6{q, b). These functions generate a submonoid of the 

monoid of all functions from Q to Q. This is the transition monoid of the automaton A and is well-studied 
in automata theory ||Str941 page 55]. We now define the 0-1 matrix Mf^ € fI'^I^I'^I ^s follows: 



The matrix is the adjacency matrix of the graph of 5^. As is a 0-1 matrix, we can consider it as 
a matrix over any field F. 

For a string w = W1W2 • • -w^ € {0, 1}* we define to be the matrix product M^^M^^ ■ ■ ■ M^^,. If 
w is the empty string, define to be the identity matrix of dimension |Q| x \Q\. Let 6^ denote the natural 
extension of the transition function to w; if w is the empty string, 5^ is simply the identity function. We 
have 



Thus, Mw is also a matrix of zeros and ones for any string w. Also, M^(qo, <?/) = 1 if and only if w is 
accepted by the automaton A. 





(1) 
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2.1 Noncommutative arithmetic circuits and automata 



This subsection is reproduced from IIAMS08I to make this paper self-contained. 

Consider the ring F{xi, • • • ,Xn} of polynomials with noncommuting variables xi, • • • ,Xn over a field 
F. Let C be a noncommutative arithmetic circuit computing a polynomial / G F{xi, • • • , Let d be an 
upper bound on the degree of /. We can consider monomials over xi, • • • , x„ as strings over an alphabet of 
size n. For our construction, it is more convenient to encode each Xj as a string over {0, 1}. We encode the 
variable Xi by the string v-i = 01*0. Clearly, each monomial over the Xj's of degree at most d maps uniquely 
to a binary string of length at most d{n + 2). 

Let A = {Q,S,qQ,qf) he a finite automaton over the alphabet {0, 1}. We have matrices M^- G fI'^'^I'^ 
as defined in Section [2l where Vi is the binary string that encodes Xj. We are interested in the output matrix 
obtained when the inputs Xi to the circuit C are replaced by the matrices M^- . This output matrix is defined 
in the obvious way: the inputs are \Q\ x \Q\ matrices and we do matrix addition and matrix multiplication 
at each addition gate (respectively, multiplication gate) of the circuit C. We define the output of C on the 
automaton A to be this output matrix Mout- Clearly, given circuit C and automaton A, the matrix Mout can 
be computed in time poly (|C|,|^|,n). 

We observe the following property: the matrix output Mout of C on A is determined completely by the 
polynomial / computed by C; the structure of the circuit C is otherwise irrelevant. This is important for us, 
since we are only interested in /. In particular, the output is always when / = 0. 

More specifically, consider what happens when C computes a polynomial with a single term, say 
/(xi, • ■ ■ , x„) = cxj-^ ■ ■ ■ Xjj., with a non-zero coefficient c E F. In this case, the output matrix Mout 
is clearly the matrix cM^.^ ■ ■ ■ My.^ = cMw, where w = Vj^ ■ ■ ■ Vj^. is the binary string representing the 
monomial Xj^ • • • Xj^. Thus, by Equation [T] above, we see that the entry MoutiQo, If) is when A rejects 
w, and c when A accepts w. In general, suppose C computes a polynomial / = Yl\=i (^i^i with t nonzero 
terms, where Cj € F \ {0} and rrii = YYj=i ^ip where di < d. Let Wi = Vi-^ ■ ■ ■ Vi^, denote the binary string 
representing monomial rrij. Finally, let = {i G {1, • • • , i} | ^ accepts Wi}. 

Theorem 2.1 HAMSOSII Given any arithmetic circuit C computing polynomial f G F{xi, • ■ ■ , x„} and any 
finite automaton A = {Q,5,qo,qf), then the output Mout of C on A is such that MoutiQo, Qf) = X] pq/ c^. 

Proof. The proof is an easy consequence of the definitions and the properties of the matrices M^, stated 
in Sectionia Note that Mout = f{M^i,- ■ ■ ,M„J. But /(M„,, ■ • • ,M„J = Y.t=i CiMu,^, where Wi = 
Vii ■ • • Via. binary string representing monomial m^. By Equation[T] we know that M^. (go, Qf) is 1 if 
Wi is accepted by A, and otherwise. Adding up, we obtain the result. ■ 

We now explain the role of the automaton A in testing if the polynomial / computed by C is identically 
zero. Our basic idea is to design an automaton A that accepts exactly one word from among all the words 
that correspond to the nonzero terms in /. This would ensure that Mout{<io, 9/) is the nonzero coefficient of 
the monomial filtered out. More precisely, we will use the above theorem primarily in the following form, 
which we state as a corollary. 

Corollary 2.2 IIAMS08I Given any arithmetic circuit C computing polynomial f G F{xi, • • • , x„} and 
any finite automaton A = (Q,5,qo,qf), then the output Mout of C on A satisfies: 

(1) If A rejects every string corresponding to a monomial in f, then MoutiQO: Qf) = 0. 

(2) If A accepts exactly one string corresponding to a monomial in f, then MoutiQO: Qf) is the nonzero 
coefficient of that monomial in f. 
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Moreover, Mout can be computed in time poly(|C|, [j4|, n). 

Proof. Both points (1) and (2) are immediate consequences of the above theorem. The complexity of 
computing Mout easily follows from its definition. ■ 

Another interesting corollary to the above theorem is the following. 

Corollary 2.3 IIAMS08 I Given any arithmetic circuit C over F{xi, • ■ ■ , Xn}, and any monomial m of de- 
gree dm, we can compute the coefficient ofm in C in time poly(|C|, dm,n). 

Proof. Apply Corollary 12.21 with A being any standard automaton that accepts the string corresponding to 
monomial m and rejects every other string. Clearly, A can be chosen so that A has a unique accepting state 
and \A\ = 0{ndm)- ■ 

Remark 2.4 Corollary 12.51 /5' very unlikely to hold in the commutative ring F[xi, • • • , For, it is easy 
to see that in the commutative case computing the coefficient of the monomial HlLi -^^ even a product 
of linear forms Hiii is at least as hard as computing the permanent over F, which is ^F-complete when 
F = Q. 

3 Noncommutative identity test based on isolation lemma 

We now describe a new identity test for noncommutative circuits based on the isolation lemma. It is directly 
based on the results from l AMSOSI . This is conceptually quite different from the randomized identity test 
of Bogdanov and Wee [BWOSj. 

Theorem 3.1 Let f G F{xi , X2, • ■ ■ ,Xn} be a polynomial given by an arithmetic circuit C of size m. 
Let d be an upper bound on the degree of f. Then there is a randomized algorithm which runs in time 
poly(n, m, d) and can test whether / = 0. 

Proof. Let [d] = {1, 2, • • • , d} and [n] = {1, 2, ■ • • , n}. Consider the set of tuples U = [d] x [n]. Let 
V = Xi^Xi^ • • • be a nonzero monomial of /. Then the monomial can be identified with the following 
subset S^oiU : 

5, = {(i,n),(2,i2),--- ,{t,it)} 
Let T denotes the family of subsets of U corresponding to the nonzero monomials of / i.e, 

= {Sv I w is a nonzero monomial in /} 

By the Isolation Lemma we know that if we assign random weights from [2dn] to the elements of U, 
with probability at least 1/2, there is a unique minimum weight set in F. Our aim will be to construct 
a family of small size automatons which are indexed by weights w G [2n(i^] and t G [d], such that the 
automata j will precisely accept all the strings (corresponding to the monomials) v of length t, such that 
the weight of 5„ is w. Then from the isolation lemma we will argue that the automata corresponding to the 
minimum weight will precisely accept only one string (monomial). Now for w G [2nd^], and t G [d], we 
describe the construction of the automaton A^, j = (Q, S, 6, qo,F) as follows: Q = [d] x [2nd'^] U {(0, 0)}, 
S = {xi,X2, ■ • • , Xn}, qo = {(0, 0)} and F = {{t, w)}. We define the transition function 5 : Q x S — > Q, 

6{{i,V),Xj) = {i + l,V + W), 
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where W is the random weight assign to {i + I, j). Our automata family A is simply, 



A= {A^^t I w G [2nd^],t G [d]}. 



Now for each of the automaton A^^t £ A, we mimic the run of the automaton A^^t on the circuit C 
as described in Section |2] If the output matrix corresponding to any of the automaton is nonzero, our 
algorithm declares / 7^ 0, otherwise declares / = 0. 

The correctness of the algorithm follows easily from the Isolation Lemma. By the Isolation Lemma 
we know, on random assignment, a unique set S in T gets the minimum weight i«min with probability at 
least 1/2. Let S corresponds to the monomial Xi-^Xi^ ■ ■ ■ x,^. Then the automaton A^^.^^e accepts the string 
(monomial) Xj^Xjj ■ ■ ■ Xi^. Furthermore, as no other set in T get the same minimum weight, A^^.^^i rejects 
all the other monomials. So the {qq, qj) entry of the output matrix Mq, that we get in running A^^-^^/ on 
C is nonzero. Hence with probability at least 1/2, our algorithm correctly decide that / is nonzero. The 
success probability can be boosted to any constant by standard independent repetition of the same algorithm. 
Finally, it is trivial to see that the algorithm always decides correctly if / = 0. ■ 



4 Noncommutative identity testing and circuit lower bounds 

For commutative circuits, Impagliazzo and Kabanets IIKI03II have shown that derandomizing PIT implies cir- 
cuit lower bounds. It implies that either NEXP ^ P/poly or the integer Permanent does not have polynomial- 
size arithmetic circuits. 

In I.AMS0 8 I we have observed that this also holds in the noncommutative setting. I.e., if noncommuta- 
tive PIT has a deterministic polynomial-time algorithm then either NEXP P/poly or the noncommutative 
Permanent function does not have polynomial-size noncommutative circuits. We note here that noncommu- 
tative circuit lower bounds are sometimes easier to prove than for commutative circuits. E.g. Nisan fN911 
has shown exponential-size lower bounds for noncommutative formula size and further results are known 
for pure noncommutative circuits l|N911lRS05l . However, proving supeipolynomial size lower bounds for 
general noncommutative circuits computing the Permanent has remained an open problem. 

To keep this paper self contained, we briefly recall the discussion from IIAMS08II . 

The noncommutative Permanent function Perm(xi, • • • , x„) G R{xi, • • • , Xn\ is defined as 



where the coefficient ring R is any commutative ring with unity. Specifically, for the next theorem we choose 



Let SUBEXP denote ne>oDTIME(2'^') and NSUBEXP denote ne>oNTIME(2'^'). 

Theorem 4.1 HAMSOSII If PIT /or noncommutative circuits of polynomial degree C(xi,--- ,x„) G 
} is in SUBEXP, then either NEXP ^ P/poly or the noncommutative Permanent function 
does not have polynomial-size noncommutative circuits. 

Proof Suppose NEXP C P/poly. Then, by the main result of IIIKW02II we have NEXP = MA. Furthermore, 
by Toda's theorem MA C p^'e''»"z^ where the oracle computes the integer permanent. Now, assuming PIT 
for noncommutative circuits of polynomial degree is in deterministic polynomial-time we will show that the 



n 
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(noncommutative) Permanent function does not have polynomial-size noncommutative circuits. Suppose to 
the contrary that it does have polynomial-size noncommutative circuits. Clearly, we can use it to compute the 
integer permanent as well. Furthermore, as in liKI03,l we notice that the noncommutative n x n Permanent 
is also uniquely characterized by the identities pi{x) = x and Pi{X) = Yl]=i xijPi-i{Xj) for 1 < i < n, 
where X is a matrix of i'^ noncommuting variables and Xj is its j-th minor w.r.t. the first row. I.e. if arbitrary 
polynomials Pi,l < i < n satisfies these n identities over noncommuting variables Xij,l < i,j < nif and 
only if Pi computes the i x i permanent of noncommuting variables. The rest of the proof is exactly as in 
Impagliazzo-Kabanets IIKIOSI . We can easily describe an NP machine to simulate a p^^'^'^z computation. 
The NP machine guesses a polynomial-size noncommutative circuit for Perm on mxm matrices, where m 
is a polynomial bound on the matrix size of the queries made. Then the NP verifies that the circuit computes 
the permanent by checking the m noncommutative identities it must satisfy. This can be done in SUBEXP 
by assumption. Finally, the NP machines uses the circuit to answer all the integer permanent queries. Putting 
it together, we get NEXP = NSUBEXP which contradicts the nondeterministic time hierarchy theorem. ■ 



5 The Results 

We are now ready to prove our first result. Suppose the derandomization Hypothesis 1 holds (as stated in 
the introduction): i.e. suppose there is a deterministic algorithm Ai that takes as input (C, n) where C is 
an n-input boolean circuit and in subexponential time computes a set of weight functions wi,W2, - ■ ■ ,wt, 
Wi : [n] —>■ [2n] such that the set system Tc defined by the circuit C has a unique minimum weight set w.r.t. 
at least one of the weight functions Wi. 

Let C'{xi,X2, ■ ■ ■ , x„) be a noncommutative arithmetic circuit of degree d bounded by a polynomial in 
size{C'). By Corollary 12.31 there is a deterministic polynomial-time algorithm that takes as input C and 
a monomial m of degree at most d and accepts if and only if the monomial m has nonzero coefficient in 
the polynomial computed by C . Thus, we have a boolean circuit C of size polynomial in size{C') that 
accepts only the (binary encodings of) monomials Xi-^Xi^ ■ ■ ■ Xi^, k < d that have nonzero coefficients in the 
polynomial computed by C Now, as a consequence of Theorem 13. H and its proof we have a deterministic 
subexponential algorithm for checking if C = 0, assuming algorithm Ai exists. Namely, we compute the 
boolean circuit C from C" in polynomial time. Then, invoking algorithm Ai with C as input we compute 
at most subexponentially many weight functions wi, - ■ ■ ,wt. Then, following the proof of Theorem 13. II we 
construct the automata corresponding to these weight functions and evaluate C on the matrices that each of 
these automata define in the prescribed manner. By assumption about algorithm ^i, if C" ^ then one of 
these Wi will give matrix inputs for the variables Xj,l<j<non which C evaluates to a nonzero matrix. 
We can now show the following theorem. 

Theorem 5.1 If the subexponential time algorithm Ai satisfying Hypothesis 1 exists then noncommutative 
identity testing is in SUBEXP which implies that either NEXP ^ P/poly or the Permanent does not have 
polynomial size noncommutative circuits. 

Proof. The result is a direct consequence of the discussion preceding the theorem statement and Theo- 
rem |4?T] ■ 

We now turn to the result under the stronger derandomization Hypothesis 2 (stated in the introduction). 
More precisely, suppose there is a deterministic algorithm A2 that takes as input (m, n) and in time poly- 
nomial in m computes a set of weight functions wi,W2,- " > wt, Wi : [n] [2n] such that for each n-input 
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boolean circuit C of size m, the set system defined by the circuit C has a unique minimum weight set 
w.r.t. at least one of the weight functions Wi. We show that there is an explicit polynomial f{xi, • • • , x„) 
in noncommuting variables Xi that does not have subexponential size noncommutative circuits. 

Theorem 5.2 Suppose there is a polynomial-time algorithm A2 satisfying Hypothesis 2. Then for all but 
finitely many n there is an explicit polynomial /(xi, • • • , x„) € F{xi, j;2i " " " > Xn\ (where the field F is 
either rationals or any finite field) in noncommuting variables Xi that is computable in 2"*^*^^ time (by a 
uniform algorithm) and does not have noncommutative arithmetic circuits of size 2°("^S"). 

Proof. Let T„ denote the set of all sequences (ii,i2, ■ ■ ■ 5^n)> for S [n], 1 < j < n. For each such 
sequence a = {11,12,- " , in) £ 7n let denote the monomial Xj^Xij ■ • • Xi^. Now, we write 

/(xi,X2,--- ■,Xn)= ^ Cama, 

where we will pick the scalars Ca appropriately so that the polynomial / has the claimed property. Suppose 
A2 runs in time m'^ for constant c > 0, where m denotes the size bound of the boolean circuit C defining set 
system J^c- Notice that the number t of weight functions is bounded by m'^. As explained in Theorem 13. 11 
each weight function will give rise to a collection of 2n^ automata Ak, each of which will prescribe matrices 
of dimension at most r = poly(n) to be assigned for the input variables Xj,l < j < n. Call these matrices 
M-^'^ . For each weight function Wi write down linear equations for each k € [2n'^] . 

This will actually give us a system of at most 2n^r^ linear equations in the unknown scalars Cq,. Since 
there are t < rrf weight functions in all, all the linear constraints put together give us a system of at 
most 2n^r^m^ linear equations. Now, the number of distinct (noncommuting) monomials nia is n" = 
2nign y;yhich asymptotically exceeds 2n^r^m^ for m = 2°("^s"\ since r is polynomially bounded. Thus, 
the system of linear equations has a nontrivial solution in the c^'s that can be computed using Gaussian 
elimination in time exponential in n. 

Notice that the polynomial /(xi, • • • ,Xn), defined by the solution to the c^'s, is a nonzero polyno- 
mial. We claim that / cannot have a noncommutative circuit of size 2°^'^ . Assume to the contrary that 
C'{xi, • • • is a noncommutative circuit of size s = 2°("^s"^) for /. Then, by Corollary 12.31 there is 
an n'-input boolean circuit C of size m = s*^^^) = 2°^"^^") that accepts precisely the (binary encodings) 
of those monomials that are nonzero in C . Let wi, - ■ ■ , be the weight functions output by A2 for input 
(m, n'). By Hypothesis 2, for some weight function Wi and some k E [2n^] the circuit C must be nonzero 

(k) 

on matrices Ml-. However, / evaluates to zero, by construction, on the matrix inputs prescribed by all the 
weight functions wi, - ■ ■ ,wt. This is a contradiction to the assumption and it completes the proof. ■ 



Remark 5.3 We can formulate both Hypothesis 1 and Hypothesis 2 more generally by letting the running 
time of algorithms Ai and A2 be a function t{m, n). We will then obtain suitably quantified circuit lower 
bound results as consequence. 

'By explicit we mean tiiat the coefficients of / are computable in time exponential in n. 
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Commutative circuits 



We now show that under the derandomization Hypothesis 3 (stated in the introduction) we can obtain a 
stronger consequence than Theorem 15. II 

Theorem 5.4 If a subexponential-time algorithm Aj, satisfying Hypothesis 3 exists then identity testing 
over Q is in SUB EXP which implies that either NEXP {Z! P/poly or the integer Permanent does not have 
polynomial size arithmetic circuits. 

Proof. Using Lemma 11.51 it is shown in MKSOU Theorem 5] that there is a randomized identity test for 
small degree polynomials in Q[xi, • • • , Xn], where the polynomial is given by an arithmetic circuit C of 
polynomially bounded degree d. The idea is to pick a random weight vector w : [n] ^ [2nd] and replace 
the indeterminate Xi by y"'^*), where d is the total degree of the input polynomial. As the circuit C has 
small degree, after this univariate substitution the circuit can be evaluated in deterministic polynomial time 
to explicitly find the polynomial in y. By Lemma [T3] it will be nonzero with probability 1/2 if (7 computes 
a nonzero polynomial. 

Coming to the proof of this theorem, if NEXP ^ P/poly then we are done. So, suppose NEXP C P/poly. 
Notice that given any monomial x'^^ ■ ■ ■ x^" of total degree bounded by d we can test if it is a nonzero 
monomial of C in exponential time ( expUcitly listing down the monomials of the polynomial computed by 
C). Therefore, since NEXP C P/poly there is a polynomial-size boolean circuit C that accepts the vector 
(di, • • • , iff • • • x^" is a nonzero monomial in the given polynomial (as required for application of 
Hypothesis 3). 

Now, we invoke the derandomization Hypothesis 3. We can apply the Klivans-Spielman polynomial 
identity test, explained above, to the arithmetic circuit C for each of the t weight vectors , • • • ,wt gener- 
ated by algorithm ^3 to obtain a subexponential deterministic identity test for the circuit C by the properties 
of ^3. Now, following the argument of Impagliazzo-Kabanets liKI03J it is easy to derive that the integer 
Permanent does not have polynomial size arithmetic circuits. ■ 

Remark 5.5 We formulate a stronger version of Hypothesis 3 to obtain a conclusion similar to Theorem \5.2\ 
for commutative circuits. For example we can formulate the hypothesis: 

There is a deterministic algorithm A4 that takes as input (m, n, K) and outputs a collection of weight 
functions 'Wi,'W2, - ' ' such that Wi : [n] [2n], with the property that for each size m, n-input oracle 
boolean circuit (where A is EXP -complete) that takes as input (ai, • • • , a„) such that Ui € {0, • • • , K}, 
there is some weight vector Wifor which there is a unique linear form (ai, • ■ ■ , a„) accepted by which 
attains the minimum value X]j=i Furthermore, A4 runs in time polynomial in m. 

It is easy to see that, similar to Theorem 15.21 as a consequence of this hypothesis there is some explicit 
polynomial f{x\, ■ ■ ■ , Xn) (i-e. computable in EXP) which does not have commutative circuits of subexpo- 
nential size. 

6 Discussion 

An interesting open question is whether derandomizing similar restricted versions of the Valiant- Vazirani 
lemma also implies circuit lower bounds. We recall the Valiant- Vazirani lemma as stated in the original 
paper IIVV86L 
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Lemma 6.1 Let S C {0, 1}*. Suppose Wi, 1 < i < t are picked uniformly at random from {0, 1}*. For each 
i, let Si = {v S \ v.Wj = 0, 1 < j < i} and let pt{S) be the probability that \Si\ = Ifor some i. Then 
Pt{S) > 1/4. 

Analogous to our discussion in Section [B here too we can consider the restricted version where we 
consider Sc ^ {0, 1}" to be the set of n-bit vectors accepted by a boolean circuit C of size m. We can 
similarly formulate derandomization hypotheses similar to Hypotheses 1 and 2. 

We do not know if there is another randomized polynomial identity test for noncommutative arithmetic 
circuits based on the Valiant- Vazirani lemma. The automata-theoretic technique of Section [3] does not 
appear to work. Specifically, given a matrix /i : F2 — > Fg, there is no deterministic finite automaton of size 
poly(n, A;) that accepts x G F2 if and only if h{x) = 0. 

Acknowledgements. We are grateful to Manindra Agrawal for interesting discussions and his suggestion 
that Theorem 15.21 can be obtained from the stronger hypothesis. We also thank Srikanth Srinivasan for 
discussions. 
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